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Abstract 

We generalize Heiberg’s number-theoretic construction of multiple insertion-deletion correcting binary codes to 
non-binary alphabets and describe a linear decoding algorithm for correcting multiple deletions. 


I. Introduction 

Heiberg codes |4] are binary codes capable of correcting multiple insertion-deletion errors. These number- 
theoretic codes generalize Levenshtein codes, first constructed by Varshamov and Tenengo’lts m to correct a 
single asymmetrical error and later proved by Levenshtein (2l to be capable of also correcting a single insertion 
or deletion error. Levenshtein’s proof included an elegant linear decoding algorithm to correct a single deletion. 
Levenshtein codes are asymptotically optimal; however, Heiberg codes correcting more than one insertion or deletion 
have a low rate m. 

Other special binary codes capable of correcting insertions and deletions include run-length limited codes by 
Paluncic, Abdel-Ghaffar, Ferreira, and W. A. Clarke ED, repetition codes by Landjev and Haralambiev Js), and 
repetition error-correcting codes by Dolecek and Anantharam (3}. There are of course codes that can correct 
insertion-deletion errors with high probability over binary symmetric channels such as concatenated codes by 
Schulman and Zuckerman cm and watermark codes by Davey and MacKay 0. These codes differ from Heiberg 
and other aforementioned codes, which guarantee correction up to a fixed maximum of insertions and/or deletions 
(or indels for short). We refer the reader to m and for an overview of insertion-deletion correcting codes and 
their applications. 

A non-binary generalization of the Levenshtein code is the Tenengol’ts code fl2l . which uses a modular relation 
to determine the value of the inserted or deleted non-binary symbol and an associated Levenshtein code to determine 
the position of that symbol. Tenengolts also gave a systematic form of his code that appends the three-bit string 
011 to each codeword to serve as check bits for detecting either an insertion or deletion and as a separator between 
codewords. A generalization of the Tenengol’ts code to one capable of correcting multiple indels was constructed 
by Paluncic, T. G. Swart, J. H. Weber, H. C. Ferreira, and W. A. Clarke f9). As with the Tenengol’ts code, their code 
uses a set of modular relations to determine the values of the deleted symbols and an associated binary multiple 
insertion-deletion correcting code to determine the positions of the deleted symbols. However, this information 
does not uniquely specify which values should be inserted at these positions; thus, their construction involves a 
purging process that requires removing unwanted codewords that yield the same deleted codeword. An upper bound 
was derived for the number of such codewords that can exist, but no efficient algorithm was given to purge these 
unwanted codewords. A lower bound for the cardinality of these codes was established, proving that they are 
asymptotically optimal, but assumes a conjecture regarding the cardinality of the associated binary code. 

In this paper we extend Heiberg’s construction of his codes a, a to non-binary alphabets. Moreover, we present 
a linear decoding algorithm to correct codewords that suffer only deletions. Our proof that these q-ary codes are 
capable of correcting multiple insertion-deletion errors follows the one given by Abdel-Ghaffar, Paluncic, Ferreira, 
and Clarke III for Heiberg codes, which we adapt for non-binary alphabets. The proof relies on an argument 
by contradiction: suppose two codewords with the same residue produce the same deleted codeword. Then the 
difference in their moments must be strictly between 0 and the modulus, which gives a contradiction since the two 
codewords are congruent. 

T. Le and H. Nguyen are with the Department of Mathematics, Rowan University, Glassboro, NJ 08012 USA (let5@students.rowan.edu, 
nguy en @ rowan. edu). 


To precisely describe our results, let A = {0,1, q — 1} be a q- ary alphabet and x = (x ±,..., x n ) £ A n be a 
codeword of length n. We shall refer to x t as the i-th symbol of x. Fix d to be a positive integer and set p = q — 1. 
Generalizing a, we define the sequence of weights W(q,d) = {w±(q, d), w 2 (q, d), ...} as follows. First, initialize 
Wi(q, d) = 0 if i < 0. Then for i < 1, define Wi(q,d) recursively by 

d 

m(q,d) = 1 +p^2wi-j(q,d). 

3=1 

When it is clear, we shall write Wi for short instead of (q. d). Next, we define the truncated codeword (x)/ r = 
(a?i,... ,Xk) to be one consisting of the first k symbols of x and its moment by Mfc(x) := M((x)j,). We shall 
also write M(xi) = WiXi to refer to the moment of the symbol x,;. 

Our new q-ary codes capable of correcting multiple insertion-deletion errors are defined as follows. 

Definition 1. Let m and r be fixed integers satisfying m > w n+ -\ and 0 < r < m. We define the code C n (q. d. m, r ) 
to be the set of codewords of length n whose moments have residue r modulo m, i.e., 

C n := C n (q , d, m, r) = {x £ A n : M(x) = r mod m}. 

To simplify the notation, we shall sometimes write C n instead of C n (q, d, m. r). In the case of a binary alphabet 
where q = 2, the codes C n {2,d,m,r) are referred to Heiberg codes ||5) . 

Given two codewords x and y of length n, we shall say that x and y are congruent and write x = y to denote 
M(x) = M( y) mod m. In that case, x, y £ C n (q,d,m,r) for some residue r where 

r = M(x) = M( y) mod m. 

Moreover, if we define A(x, y) = M(x) — M{ y), then x = y is equivalent to A(x, y) = 0 mod m. 

Define S(n) = {1, ...,7i}. Let D be a non-empty subset of S(n) with |ZT|< d. Set n' = n — |D| and define 
S' = S(n) — D = {*!, with ii < i 2 < ... < i n >. Moreover, define x^ 13 ^ = (x^, ...,Xj ,) to be the codeword 

obtained by deleting the elements of x indexed by D. We shall refer to x' : r>> as a deleted codeword of x. We also 
define the index of x' : / '- ) to be difference in moments between the original codeword and its deleted codeword: 

I := J(x (D) ) = M(x) - M(x ( d) ). 

We prove in Section [II] that the code C n (q , d. m, r ) is capable of correcting up to d deletion errors. In particular, 
let x, y £ C n (q,d,m,r) be two distinct codewords and suppose there exists subsets D and E of S(n) such 
that \D\= \E\< d and x^ . We show that 0 < A(x, y) < m, which is a contradiction since x = y. 

Thus, no such subsets exist. Hence, C n (q,d,m,r) is a (/-deletion correcting code. By a result of Levenshtein Q, 
C n (q, d,m,r) is also capable of correcting a total of d indels. 

In Section [im we present a linear search algorithm to decode codewords in C n that suffer only deletions. Suppose 
a codeword x is transmitted, but is corrupted so that the received codeword, denoted by x', consists of deletion 
errors. The goal of our algorithm to find the correct positions to re-insert into x' the symbols that were deleted 
so that the index / reduces to zero. In particular, we start with the assumption that our deleted symbols should be 
inserted at the right end of x'. If these symbols are not in their correct positions, then we shift them to the left as 
far as possible and update the index / by subtracting the change in the weight of each moving symbol from the 
current value of I. The algorithm terminates when 1 = 0. For the correction of one deletion error, the algorithm 
essentially performs an exhaustive trial-by-error search. However, for two or more deletion errors, the algorithm is 
recursive in the following sense: assuming that (/-deletion errors have occurred, the algorithm corrects the rightmost 
deleted bit, after which the decoding reduces to the algorithm for correcting (d — l)-deletion errors. Moreover, 
for d > 2, the algorithm is efficient because its complexity is linear, namely 0(n), where n is the length of the 
transmitted codeword. 

Lastly, in the Appendix B, we present values for the size of the largest code C n (q, d, m, r) for certain values of 
q, d, and n. These values were found through exhaustive computer search. 
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II. Generalized Helberg Codes 


Our proof that C n (q , d. to, r) is a d-deletion error-correcting code follows the proof given in (T), where we adapt 
their arguments for </-ary alphabets. We shall need the following lemma, which allows us to replace the rightmost 
non-zero bit with the value 0 in any two codewords that are congruent and have the same deleted codeword. This 
assumes that the rightmost nonzero bit is the same for both codewords. 

Lemma 2. Let x and y be two codewords of length n with the following two properties: 

(1) x = y. 

(2) x.- 11 ' 1 = for some subsets D and E of { 1, ...,n} with |D| = |i£|< d. 

Suppose there exists a positive integer L such that Xl = > 0 and ay = yj = 0 for all i > L. Then there exist 
codewords x. and y where ay = ay, yi = yi for all i L and xl = Vl = 0 such that x and y have the same two 
properties as x and y, namely 


(i) x = y. 

(ii) x ID ' 1 = y( E ) for some sets D and E having the same size as D and E. 


Proof: Define x and y according to the lemma. Since ay — yi = ay — y, for all i = 1,..., n, it follows that 
M(x) — M{ y) = M(x) — M{ y). But x = y; hence, x = y. This proves (i). To prove (ii), we consider four cases: 

Case I: Assume L £ D fl E. In this case, the nonzero bits xl and y /, are deleted from x and y, respectively, to 
obtain x^ D> and y( E \ Define D = D and E = E. Since yf 0 '* = y^ E \ it follows that x^ = y(^) since the zero 
bits x and ;/)/ are deleted from x and y, respectively, as well. 

Case II: Assume L D U E. Since = y^ E \ it follows that xl and y l appear in x ( - D ' 1 and y^ as the 
rightmost nonzero bit, respectively. But then replacing xl and y^ by Xj y and y /., respectively, yields x ! D ) = y( E \ 
Thus, it suffices to again define D = D and E = E. 

Case III: Assume L € D — E. In this case, the bit xl is deleted from x to obtain x ! l:>) , but the bit yL is not deleted 
from y and therefore appears in y^ E \ Let z denote the number of bits to the right of yi, in y ! ' ,<: K which must all 
be 0 since y, = 0 for all i > L. Then the number of bits to the right of yj J that are deleted from y to obtain y <E> 
equals z’ = n — L — z. Let I\ denote the position of the rightmost nonzero bit xk of x^ D \ Since x^ = y( E \ 
it follows that xk = Vl = xl and that the number of zeros to the right of x k in x (,)> also equals z. Therefore, 
the number of bits to the right of xk that are deleted from x to obtain x f 1,1 equals n — K — z. We now define 
D’ = {K , K + 1,..., L — 1, L + 1,..., L + z'} where we exclude L. It follows that x^ D ’^ = x^ with \D'\= \D\. 
Since L ^ D' UB, this reduces to Case II where D is replaced by D'. 

Case IV: Assume L £ E — D. The argument in this case is the same as Case III with the roles of D and E reversed. 

■ 

Theorem 3. Let x and y be two codewords of length n that satisfy properties (1) and (2) in Lemma\2\ Then 


0 < |A(x,y)|< m. 

Proof: We shall first prove that |A(x, y)|< to. To begin, we rewrite A(x, y) as follows: 
A(x,y) =M(x)-M(y) 


n 



ieD 

where n! = n — \D\. This yields the bound 


j&E 


n 
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Next, we partition S(n') = {1, 2, n'} into those elements k where ik < jk and those where ik > jk to obtain 

A(x, y ) <22 WiXi + E - u ’jk )xi k 

i&D keS(n ) 

ik <jk 

+ E (' W ik~ W jk) X ik 

k£S(n') 
ik >3k 


We now add and subtract as follows: 


< 22 w i x i 4 

- E ( w ik~ w 3k) x i k 

ieD 

k£S(n') 
ik >jk 

< ^2 P w i + 

E - w ok ) 

iGD 

k^S(n') 
ik >jk 

= E PWi + 

E pWt * - E pw 3* 

i£D 

k^S(n') k£S(n') 

ik>jk ik>jk 

< '22 p^i + 

E p ^ + E pwi K 

ieD 

k^S(n') k£S(n') 

ik>3k ik<jk 

- E 

pW ik - E PW i« 

k£S(n') 

k£S(n') 

ik<3k 

ik >jk 

n 

n' 

= 22 pm - 

y^ J P w min(w il .,Wj u ) 

i= 1 

k= 1 

n 

n' 

< 22 pm - 

22 pwk 

i— 1 

fc=i 

n 

n—n 

< E pw ‘ 

i = E pW n+\-3 

i=n'-\- 1 

3= 1 


< P^2 Wn+l-j = W n+ l - 1 

i =l 

< m. 


On the other hand, by reversing the roles of x and y, we obtain A(y, x) < to, which implies A(x, y) = - A(y, x) > 
—to. Hence, |A(x,y)|< to. as desired. 

Next, we prove that A(x, y) ^ 0 by considering four different cases. By Lemma 1 we can assume without loss 
of generality that there exists an integer L £ {1,..., n} such that xl > Ul and Xi = yi = 0 for all i > L. 

Case I: Assume L £ D n E. Then ik ^ L for all k = 1, ...,n!. Decompose 

n' 

A(x, y) = 22 w i x i - E w i y i + E( w bc “ W 0 k ) x ik ■ 

i€D jeE fc=1 
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The first two summations on the right-hand side is bounded below by 

Y WiXi - Y w jyj 

ieD jeE 

= W L X L + ^2 W i X i ' W LVL - Y 


m 


ieD 
i<L — l 


jeE 
3<L -1 


>W L - Y 


v jVj 


jeE 
j<L- 1 


bounded below by 


n 

Y( wi k - w jk)xi k 


k=1 


•Si 

§T 

-se 

jT 

w 

II 

) a: u + (' 

k€.S(n') 

k£S(n') 

ik <jk 

ik >jk 

> Y ■ 

~ w jk)Xi k , 


k£S(n') 
ik<jk,ik<L -1 

where we have used the fact that ik ^ L and Xi k = 0 for ik > L. It follows that 

A(x,y) 


>w l ~y w jVj + Y p ( Wi * - 


J 3k > 


jge 
j<L -1 

since Xi k < p. Next, we use the decomposition 

L—l 


ik<jk,ik<L — 1 


Y pw o= Y pw i + Y pw i* 

3 =1 jeE keS(n‘) 

j< L ~ l ik<jk,ik<L -1 

+ Y pw i* 

k£S(n') 

ik>jk,ik<L-l 


to obtain 


L—l 


A(x, y) >w l ~Y pw 3 + Y 


pw ik 


j =i 


k£S(n') 
ik<jk,ik<L -1 


+ Y pw ^ ■ 


This equivalent to 


fcG5(n') 
ik>jk,ik<L — 1 


L—l 


A(x, y) > WL - H PWmin(i k ,j k )- 


3 = 1 keS(n') 

ik<L — 1 


(1) 
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Since k < mm(ik,jk), we have 


L —1 min(n / ,L —1) 

A(x, y) > w L - Y pwj + Y pw k 
j =1 k— 1 

L—l 

= WL - Yj P Wi 

i=min(n / ,L—1) 

L—l 

>w L - Y p w i 

i—L—d 

> i, 

where we have used the fact that L — d < min(n', L — 1). Also, recall that L < n = n! + d and d> 1. 

Case II: Assume L £ D — E. Recall that xl > Vl and Xi = iji = 0 for i > L. Since L ^ E, it follows that 

n' 

A(x, y) = ^ ^ Wjyj + ^2{w ik - w jk )x ik 

i£D j£E k— 1 

= wlXl + ^ Wia:* - ^ Wjt/j 

te-D jes 

i<L-l j<L -1 

n' 

fc=l 

Analogously, we partition S'(n') into those elements A: where Z& < jk and those where ik > jk to obtain 

A(x,y) 

>W L X L - J2 W oVi + X] ( W ik - W jk) x ik 

j&E k£S(n') 

3<L-l i k <j k 

+ X] 

k€S(n') 

ik>jk 

>W L X L - Y WjVj+ Y ( W ik~ W 3k) X ik 
j£E kGS(n') 

3 - L ~ 1 ik<jk 

> w l- Y w i y i 

j£E 
3<L- 1 

k£S(n r ) 
ik<jk,ik<L—1 

The rest of the argument now follows the same as that in Case I to establish that A(x, y) > 1. 

Case III. Assume L £ E — D. The argument in this case is the same as Case II by switching the roles of D and E. 

Case IV. Assume L ^ D U E. Then ix = L for some ix £ S'. We claim that jx < t x — 1- Since x^ = y^ E \ it 
follows that Xi K = yj K . On the other hand, we have yi K < Xi K and jji = 0 for all i > L = ix- Thus, jx < ii< — 1. 
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We now proceed similarly as in previous cases: 

A(x,y) 


= E WiXi ~ E w iVi + E( Wi * - w jk ) 3 


ieD jeE 

i<L-l j<L -1 


fc=1 


> - E w jyj+ E 


jeE 
3<L -1 


k£S(n') 

ik<jk 


+ E ( W ^~ W 3k) 3 


k£S(n') 
ik >jk 


> - E w jyj+ E 


jeE k£S(n') 

3< L ~ l i k <j k ,i k <L-l 


+ ( 


Wi* -w jic )x itc . 


Next, since Xi < p for all z £ N, we have 

A(x,y) 


= WL~ PWj K 


- E 

jeE 
j<L -1 


PVj 


E w*- 


E - 

keiS(n') k£S(n') 

ik<jk,ik<L — 1 ik<jk,i k <L — 1 


Again, using ©, we obtain the lower bound 


L —1 


A(x, y) > w L - ^ pwj + ^2 P w i k 


j =1 fceS(n') 

ik<jkjk<L -1 

E ■ 

k£S(n') 
ik>jk,ik<L-1 


The rest of the proof is the same as that in Case I. Therefore, A(x, y) > 1. Hence, 0 < |A(x, y)|< m as desired. 

■ 

Theorem 4. The code C„ (q. d. m, r) is a d-insertion-deletion correcting code. 

Proof: Suppose on the contrary that C n (q,d,m,r) is not capable of correcting up to d deletions. Then there 
exist two codewords x,y £ C n (q,d,m,r) and subsets D and E with |D|= |i?|< d such that x (w ) = y < - E \ By 
Theorem[3] we have 0 < |A(x, y)|< m. It follows that x ^ y, a contradiction. Thus, C n (q, d,m,r) is capable of 
correcting up to d deletions, and therefore, can correct up to d insertion-deletion errors as well due to a result of 
Levenshtein 0. ■ 


III. Decoding of Generalized Helberg codes 

In this section, we describe a linear decoding algorithm to correct deletion errors in a generalized Heiberg 
codeword x £ C n (2. d. rn. r) where c deletions have occurred with c < d. We first present an algorithm to correct 
one deletion and then provide a recursive algorithm to correct two or more deletions. 


7 


A. Decoding One Deletion 

In the decoding of one deletion, our algorithm is the same as exhaustive trial-by-error search. Let x £ C n (q. d, to, r) 
and x' be the deleted codeword obtain from x by deleting one symbol. We assume d > 2; otherwise, if d = 1, 
Levenshtein decoding should be used. Then x' has length n — 1. We define x = (ii,... ,x n ) to be the initial 
decoding of x' where we append a variable symbol S to x' at initial position P = n, i.e., the right-most position: 

x= {x' l ,x' 2 ,...,x' n _ 11 5). 

Let I = M(x) — M (x') denote the index (Lemma [TOl in Appendix A shows that it possible to determine M(x) 
from M(x')). We then attempt to decode x in order to obtain the original codeword x so that M(x) = M(x) 
by either inserting a value for 5 or shifting this deleted symbol to the left of x' P _ 1 . The decision is based on the 
following condition, which compares the current index I and the moment of 5 at position P: 

Algorithm D1 (Decode One Deletion): Let P = n. If I = <j ■ wp for some value a £ {0,1,... ,p}, then 5 
is in its correct position as the symbol that was deleted from x. To decode, set S = o. Otherwise, shift x' P _ 1 to 
the right of <5 (equivalent to shifting 6 to the left one position), update /—)•/ — x' P _ 1 (wp — wp- 1 ), and update 
P —>• P — 1. This is repeated until the the correct position and value for 6 is found. 

It is clear that algorithm D1 will correctly decode x' since it essentially performs an exhaustive search (assuming 
that x exists). We illustrate this algorithm in the following example. 


Algorithm D1 (Decode One Deletion) 


1 

x = x[x , 2 x' 3 ...x' n _ 1 S t> Initialize x by appending variable symbol <5 to x' at position n, where <5 is to be 


determined. 


2 

for P = n to 1 do 

> P denotes position of <5 

3 

for a = q — 1 to 0 do 

D> c7 denotes test value for <5 

4 

if I = a ■ wp then 


5 

6 = a 


6 

STOP 


7 

end if 


8 

end for 


9 

X = X 3 X 2 X 3 . . . X p _ 2 Sx p _ 1 X p+1 . . . X n _ 1 

t> Shift x' p _ 1 to the right of 5 and update x 

10 

1=1 — x'p_ 1 (wp — wp- 1 ) 

t> Update the index 

11 

end for 



Example 5. Suppose the ternary codeword x = (1, 2, 2,0, 2, 2,1,2) £ C'yfS, 2, wg, 23) was transmitted and x' = 
(1, 2, 2, 0, 2,1, 2) was received so that one deletion occurred. We wish to decode x' to recover x. The weights w L 
corresponding to this codebook are defined by the recursion Wi = 1 + 2(wj_i + Wj_ 2 ). The first 10 weights are 
given in Table Q] In particular, wg = 3861. 


TABLE I 

Weights id; for d = 2, q = 3 


i 

Wi 

i 

Wi 

i 

1 

6 

189 

2 

3 

7 

517 

3 

9 

8 

1413 

4 

25 

9 

3861 

5 

69 

10 

10549 


Since m = Wg = 3861, r = 23, and M(x') = 1386, and M(x') > r, it follows from Lemma flOl in Appendix A 
that M(x) = 3884. Thus, the index I = Af(x) — M(x') = 2498. As defined earlier, let x be our initial decoding 


8 


















for x' where we initially insert a variable symbol 8 at the right-most position of x', namely at position P = 8: 

x= (1,2,2,0,2,1,2, 6 ). 

According to algorithm Dl, since I ^ a ■ w$ for all a £ {0,1,2}, we shift Xj = 2 to the right of 8 , update 
P —> P — 1 = 7, and update the index /—>•/ — Xt(ws — wf) = 706 so that x now appears as 

x — (1) 2,2, 0,2,1, 8 , 2). 

Again, since I ^ a -w-j for all a £ {0,1, 2}, we shift 5:6 = 1 to the right of <5, update P —> P — 1 = 6, and update 
I I — x 6 (wy — w 6 ) = 378. Then 

51 =(1,2,2,0,2, <5,1,2). 

We now find that I = o * w$ = 378 for a = 2. In that case, we set 8 = 2 and set 7 = 0. This gives the original 
codeword 

x= (1,2, 2,0,2,2,1,2) = x 

and completes the decoding. 

B. Decoding Two Deletions 

For binary Heiberg codes capable of correcting two deletions, we shall describe a recursive algorithm to decode 
a codeword where two symbols have been deleted by reducing the problem to that of correcting one deletion, a 
problem that was solved in the previous sub-section. 

Suppose x' is obtained from x £ C n (2, 2, rn. r) after deleting two symbols from x. Then to decode x', whose 
length is n — 2, we again define x to be an initial decoding of x where we insert two variable symbols <5i and 82 
at the right end of x', namely at positions P — 1 and P, where we initially set P = n: 

x (x-^, x 2 , • • •, x n _ 2 , (5i, 82 )- 

We calculate / = M(x) — M(x') (use Lemma [TOl in Appendix A to determine M(x)). Our algorithm essentially 
determines whether to set 82 equal to an alphabet symbol (0 or 1), in which case the decoding reduces to the 
one-deletion algorithm Dl, or shift x ' P _ 2 (initially x' n _ t ) to the right of 82 ■ The following conditions describe 
when each action is executed. 

Algorithm D2-Binary (Decode Two Deletions): Let P = n. If 

I = criwp-i + <J2Wp ( 2 ) 

for some 01,02 £ {0,1}, then 81 and 82 are in their correct positions as symbols that were deleted from x. To 
decode, set 8 \ = <7i and 82 = 02 - 

Otherwise, we assume that either <5i or 82 (or both) are NOT in their correct positions in what follows. Then 

1) For wp > /: 

a) If x ' P _ 2 = 0, then shift x ' P _ 2 to the right of 82 , i.e., to the right of 82 - 

b) If x ' P _ 2 = 1 and 

i) I < wp — wp- 2 , then set 82 = 0 and update the index /—>■/— (wp -1 — wp- 2 ). 

ii) I > wp — wp- 2 , then shift x ' P _ 2 to the right of 82 and update the index /—>■/— (wp — wp- 2 ). 

2) For wp < /: 

a) If x ' P _ 2 = 0, then set 82 = 1 and update / —> / — wp. 

b) If x ' P _ 2 = 1, then shift x ' n _ 2 to the right of 82 and update /—>•/— (wp — wp- 2 ). 

Update P —> P — 1 and repeat algorithm until the correct position and value for 82 is found. If 82 is found but <5i 
remains unknown, then apply the one-deletion algorithm Dl to determine 5i. 

Proof of Algorithm D2-Binary: To prove conditions (1) and (2) are valid, we argue as follows. 

(1) Suppose wp > I. We consider two cases: 

(a) x ' P _ 2 = 0. We consider two situations and show that x ' P _ 2 should be shifted to the right of 82 in both 
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situations: 

(i) S ‘2 is in its correct position as the right-most deleted symbol. In that case, since wp > /, there is only one 
choice of symbol for <5-2, namely <5 2 = 0; otherwise, if S 2 = 1, then the moment for x will exceed that of x up to 
position P, regardless of the position of <5i in the final decoding for x: 

Mp(5c) > Mp(x') T M (^ 2 ) = Mp(x') +wp5 2 
> Afp(x') + I = Mp(x). 

But observe that setting 82 = 0 is equivalent to shifting x ' P _ 2 = 0 to the right of <52. Thus, we choose to shift 
instead. 

(ii) 82 is NOT in its correct position as the right-most deleted symbol. In that case, we are forced to shift x ' P _ 2 to 
the right of 8 2 . 

(b) x ' P _ 2 = 1. We consider two sub-cases: 

(1) / < Wp — wp- 2 - We claim that S 2 is in its correct position as the right-most deleted symbol. Otherwise, we 
are forced to shift x ' P _ 2 to the right of 8 2 , but then the moment of x will exceed that of x up to position P: 

Mp(x) > Mp(x') + (wp — Wp- 2 ) 

> Mp(x) — I + (wp — wp- 2 ) > Mp(x). 

Thus, 82 is in its correct position and moreover, 82 = 0, since wp > I. 

(ii) I > wp — wp- 2 - We claim that 82 is NOT in its correct position. Otherwise, (P = 0 since wp > I and so 

x , x 2 , • • • j xp_ 2l 81 1 82 0, Xppi ,..., x n ) . 

But then the moment of x, which is maximized if <5i = 1, will always be strictly less than the moment of x up to 
position P: 

Mp(x) < ATp(x') + wp -1 < Mp(x') + wp — wp -2 
< Mp(x r ) + I = Afp(x). 

Thus, 82 is not in its correct position. Therefore, Xp_ 2 should be shifted to the right of 82 - 

(2) Suppose wp < I. We again consider two cases: 

(a) x ' P _ 2 = 0. We claim that 8 2 is in its correct position as the right-most deleted symbol. Otherwise, if 8 2 is 
not in its correct position, then we are forced to shift x ' P _ 2 to the right of 82 , in which case 

X (*£li ■ * * 5 Xp_ 3, (il , <5 2 , Xp _2 0, • • •, X n J . 

But then the moment of x, which is maximized if <5i = <52 = 1, will always be less than the moment of x up to 
position P: 

M P (x ) < Afp(x') + (wp -2 + wp- 1 ) 

< Mp(x r ) + wp < Mp{x.') +1 = Mp(x). 

Thus, 82 is in its correct position. Next, we claim that <52 = 1. Otherwise, if 82 = 0, then the moment of x, which 
is maximized if <5i = 1, will always be less than the moment of x up to position P: 

Mp(x) < Afp(x') + wp -1 < Mp(x') + wp 
< Mp(x r ) +1 = Mp(x). 

(b) x'p _ 2 = 1- We consider two situations and show that x ' P _ 2 should be shifted to the right of <52 in both 
situations: 

(i) 8 2 is in its correct position. We claim that <52 = 1. Otherwise, if 82 = 0, then the moment of x, which is 
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maximized if <5i = 1, will always be less than the moment of x up to position P: 

Mp(x) < Mp(x') + {wp -2 +wp- 1 ) 

< Mp(x') + wp < Mp(x') + 7 = Mp(x). 

Thus, <$2 - 1. But observe that setting <52 = 1 is equivalent to shifting x ' P _ 2 = 1 to the right of T>- Thus, we 

choose to shift instead. 

(ii) 82 is NOT in its correct position. In that case, we are forced to shift x ' P _ 2 to the right of 8 2 . 

This completes the proof. ■ 

We now demonstrate algorithm D2-Binary in the following example to show how the problem of decoding two 
deletions can be reduced to that of decoding one deletion. 


Algorithm D2-Binary (Decode Two Deletions) 


1 

x = x^x^ ... x' n _ 2 SiS 2 > Initialize x by appending variable symbols 81 
respectively, where 8 1 and <52 are to be determined. 

and <5 2 to x' at positions n — 1 and n 

2 

for P = n to 1 do 

> P denotes position of 82 

3 

for <7i, <72 = q — 1 to 1 do 

[> Double nested for loop 

4 

if I = aiwp-i + (J 2 Wp then 


5 

<5l = <7 1 , 82 = <72 


6 

STOP 


7 

end if 


8 

end for 


9 

if wp > I then 


10 

if (x ' P _ 2 = 0) or (x ' P _ 2 = 1 and / > wp — wp - 2 ) then 


11 

x = x' 1 x 2 ...x' P _ 3 5 i 82 x' P _ 2 x' P+ 1 ...x ' n _ 2 > Shift 

x'p _2 to the right of <52 and update x 

12 

1 = 1 — x'p_ 2 (wp — Wp- 2 ) 

[> Update the index 

13 

else 


14 

X — X 2 3?2 • • p _ 2^l0#p_|_i _ 2 

D> Insert 0 for <52 and update x 

15 

Call algorithm D1 to decode <5i 


16 

STOP 


17 

end if 


18 

else 

I> Wp < I 

19 

if x ' P _ 2 = 0 then 


20 

x' = x' 1 x 2 ...x , P _ 2 S 1 lx , P+ 1 ...x ' n _ 2 

t> Insert 1 for <52 and update x 

21 

1 = 1 — Wp 

i> Update the index 

22 

else 

X p _2 — 1 

23 

x' = x' 1 x' 2 ...x' P _ 3 8 i 82 x' P _ 2 x' P+l ...x ' n _ 2 i> Shift 

x ' P _ 2 to the right of <52 and update x 

24 

1 = 1 — x'p_ 2 (wp — Wp- 2 ) 

t> Update the index 

25 

Call algorithm D1 to decode <5i 


26 

STOP 


27 

end if 


28 

end if 


29 

end for 



Example 6. Suppose x £ Cio(2, 2, wn, 62) was transmitted and x' = (1,1,0,1,0,1,0,1) was received so that two 
deletions occurred. The weights Wi are defined by Wi = 1 + u ! ,-i +2 (see Table Hill. Therefore m = wn = 232 
and M(x') = 84. 

Since M(x') > r = 62, it follows that M(x) = r + m = 294. Thus, I = M(x) — M(x') = 210. We initialize 

x= (1,1,0,1,0,1,0,1, St, 62 ) 

and apply algorithm D2. Since © fails, we compare wio = 143 with I. As wio < I and x' 8 = 1, we shift x 8 to 
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TABLE II 

Weights wt for d = 2, q = 2 


i 

Wi 

i 

Wi 

1 

1 

7 

33 

2 

2 

8 

54 

3 

4 

9 

88 

4 

7 

10 

143 

5 

12 

11 

232 

6 

20 

12 

376 


the right of 82 and update the index: / —> / — (w 10 — wg) = 121. Then x takes the form 

x= (1,1,0,1,0,1,0, 5 i,5 2 ,1). 

Again, since © fails, we compare wg = 88 with I. As wg < I and x' 7 = 0, we set 82 = l and update 
I —» I — wg = 33 so that 

x= (1,1,0,1,0,1,0,5!, 1,1). 

From here, we apply algorithm D1 to determine 5, which yields 81 = 1 at position 7. Thus, 

x=(l,l,0,l,0,l,l,0,l,l) = x. 


C. Decoding Multiple Deletions 

Suppose x' is obtained from x £ C n {q. d. rri. r) after deleting c symbols from x, where 2 < c < d. Then to 
decode x', whose length is n — c, we again define x to be an initial decoding of x where we insert c variable 
symbols 81 ,... ,S C at the right end of x', namely at positions P — c + 1,..., P, where we initially set P = n: 

X (^T? x 2 ) * • * ) x n-ci 5i, . . . , 5 C ). 

We calculate I = M(x) — M(x') (use Lemma flOl in Appendix A to determine M(x)). As before, our algorithm 
essentially determines whether to set the right-most symbol <5 C equal to an alphabet symbol (0, 1), in which 

case the decoding reduces to algorithm DM for c — 1 deletions, or shift x’ P _ c (initially x' n _{) to the right of 8 C . 
The following conditions describe when each action is executed. 

Algorithm DM (Decode Multiple Deletions): Let P = n. If 

I = aiwp- c+ i + a 2 wp - c+2 + ... + a c w P (3) 

for a set of values o\..... a c £ {0,1,... ,p}, then 5i,..., 5 C are in their correct positions as symbols that were 
deleted from x. To decode, set Si = 0 , for i = 1,... ,c. Otherwise, we assume that at least one of the symbols 
5i,..., S c are NOT in their correct positions in what follows: Define 

Chnax = max{(7 : a(w P - w P _ c ) < I, a = 0,1,... ,p}. 

Then 

1) For wp > /: 

a) If x' P _ c = 0, then shift x' P _ c to the right of 8 C , update the position P —» P — 1, and repeat algorithm. 

b) If x' P _ c > 1 and 

i) I < wp — wp- c , then set 8 C = 0 and apply algorithm DM on the truncated codeword (x)p_ 1 = 
(; x ' 1; ..., x' P _ c , 5i,..., 5 c -i) with index / to correct c — 1 deletions. 

ii) I > wp — wp- c , then shift x' P _ c to the right of S c , update the index / -A / — x' P _ c (wp — wp - c ), 
update the position P —> P — 1, and repeat algorithm. 

2) For wp < P. 
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a) If x' P _ c > o' max 5 then set 5 C = a max , update the index I —f I — a max wp, and apply algorithm DM on the 
truncated codeword (x)p_i = (x \,..., x' P _ c , 6 1 ,..., <5 c _i) with index I to correct c — 1 deletions. 

b) If x' P _ c < <7 max and 

i) a max wp < /, then set 6 C = < 7 max , update the index I —>• I — u max wp, and apply algorithm DM on the 
truncated codeword (x) p_i = (x [...., x' P _ c , Si,..6 c -i) with index I to correct c — 1 deletions. 

ii) cr max wp > /, then shift x' P _ c to the right of 8 C , update the position P —> P — 1, and repeat algorithm. 

c) If x' P _ c = (7 max , then shift x' P _ c to the right of 5 C , update the index /—>•/ — er m ax(inp — wp- c ), update 
the position P —>• P — 1, and repeat algorithm. 

Proof: We prove that the conditions (1) and (2) in algorithm DM give a correct decoding of x'. 

(1) Suppose wp > I. We consider two cases: 

(a) x' P _ c = 0. We consider two situations and show that x' P _ c should be shifted to the right of S c in both 
situations: 

(i) S c is in its correct position as the right-most deleted symbol. In that case, since wp > I. there is only one choice 
of symbol for S c . namely 5 C = 0; otherwise, if S c > 1 , then the moment for x will exceed that of x up to position 
P, regardless of the position and values of the other symbols Si,..., 6 C -1 in the final decoding for x: 

Mp(x) > Mp(x') + M(S C ) = Mpfx!) + wpS c 
> Mpfx!) +1 = Mp(x). 

But observe that setting 5 C = 0 is equivalent to shifting x' P _ c = 0 to the right of S c (and later setting <5i,..., S c -1 
equal to appropriate values determined by our algorithm). Thus, we choose to shift instead. 

(ii) S c is NOT in its correct position as the right-most deleted symbol. In that case, we are forced to shift x' P _ c to 
the right of S c . 

(b) : x' P _ c > 1. We consider two sub-cases: 

(1) I < wp — Wp- C . We claim that 5 C is in its correct position as the right-most deleted symbol. Otherwise, we are 
forced to shift x' P _ c to the right of S c , but then the moment of x' will exceed that of x up to position P, regardless 
of the position and values of the other symbols Si,..., <5 c _i: 

Mp(x) > Mp(x') + x' P _ c (wp - wp- c ) 

> Mp(x) — I + (wp — wp- c ) > Mp(x). 

Thus, 8 C is in its correct position and moreover, 5 C = 0 since wp > I. 

(ii) I > wp — wp- c . We claim that S c is NOT in its correct position. Otherwise, S r: = 0 since wp > I and so 

x (aq, X 2 1 • • •, Xp_ c , Si ,..., Sq — 1 ,0, xpp^,, x n ). 

But then the moment of x, which is maximized if <5i = ... = S c -1 = p (recall p = q — 1 ), will always be strictly 
less than the moment of x up to position P: 

Mp (x) < Mp(x') + p{wp- c +i + ... + w P - 1 ) 

< Mp(x') + Wp - p(wp — c + . . . + Wp-d) 

< Mp(x) + wp — wp-c 

< Mpfx 1 ) + I = Mp(x). 

Thus, 5 C is not in its correct position. Therefore, x' P _ c should be shifted to the right of 5 C . 

(2) Suppose wp < I. We first prove that if S c is in its correct position, then 8 C = a max . We rule out all other 
possible values as follows: 

(i) Suppose S c = rr < cr max . But then the moment of x up to position P, which is maximized if <5i = ... = S c -1 = p, 
will always be less than the moment of x because of the following calculation (recall the recurrence satisfied by 
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wp and the fact that a max (wp — wp- c ) < I): 

Mp(x) 

< Mp(x') + p(wp - c+ 1 + ... + wp- 1 ) + a ■ wp 

< Mp(x') + (cr + l)wp - p(wp-c + • ■ • + wp-d ) 

< Mp (x) + a max (w P - U>p_ c ) 

< Mp(x') + / = Mp(x). 

(ii) Suppose 5 C = cr > cr ma x- But then the moment of x up to position P, which is minimized if <5i = ... = 8 C -1 = 0, 
will always be greater than the moment of x because of a similar calculation: 

Mp(x) > Afp(x') + a ■ wp 

> Mp(x') + (r(t«p — wp- c ) 

> Mp(x') + I = Mp(x). 

Thus, 8 C = cr m ax if it is in its correct position. 

Next, we consider three cases: 

(a) x'p > er max . We claim that S c is in its correct position. Otherwise, we are forced to shift x' P _ c to the 
right of S c , but then the moment of x, which is minimized if c>i = ... = 8 c -i = 0, will always be greater than the 
moment of x up to position P: 

Mp(x) > Mp(x') + x' P _ c {wp — wp- c ) 

> Mp(x') + I = Mp(x). 

Thus, S c is in its correct position and as we argued previously, 8 C = <r max . 

(b) x' P _ c < c max - We consider two sub-cases: 

(i) Prnax wp < I. We claim that S c is in its correct position. Otherwise, we are forced to shift x' P _ c to the right of 
5 C , but then the moment of x, which is maximized if <5i = ... = S c -1 = p, will always be less than the moment 
of x up to position P. This is because 

Mp(x) < Mp(x') +p(wp- c + ... + tup-i) 

+ x' P _ c {wp - Wp- C ) 

< Mp(x') + Wp - p(wp - c -1 • • • + Wp-d) 

+ x'p_ c (wp - Wp- C ) 

< Mp(x') + (1 + x' P _ c )wp 


Next, we use the fact that x' P _ c < er max to obtain 

Mp(x) < Mp(x') + <r max w P 

< Mp(x') +1 = Mp(x). 


Thus, we set S c = cr max - 


(ii) <7ma.xWp > I. We claim that 5 C is NOT in its correct position. Otherwise, if S c is in its correct position, then 
we must have S c = & max and so the moment of x up to position P, which is minimized if <5i = ... = S c - i = 0, 
will always be greater than the moment of x: 

M P (x) > Afp(x') + <r max w P 

>Mp(x')+I = Mp(x). 
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Thus, we shift x' P _ c to the right of S c . 

(c) x' P _ c = cr max . In this case, observe that if 6 C is in its correct position, then 5 C = <r max , but this same 
result can be achieved by shifting x' P _ c to the right of S c (and later setting <5i,..., <5 c _i equal to appropriate values 
determined by our algorithm). Thus, we choose to shift instead. This completes the proof. ■ 

We demonstrate algorithm DM with the following example. 

Example 7. Suppose a ternary codeword x £ Cs(3, 2, wg, 23) of length 8 was transmitted and the deleted codeword 
received x' = (1, 2, 2,0,1, 2) was received where two symbols were deleted. We have m = wg = 3861; see Table 
Q] for a list of the weights Wi. 

Since M(x') = 504 > r, it follows from Lemma [TOl that M(x) = m + r = 3884. Thus, the index I = 

M(x) — M(x') = 3380. We now apply algorithm DM by defining our initial decoding as 

x=(1,2 } 0,2 ) 1,2,5 1} 5 2 ). 

Since © fails, we compare w$ = 1413 with I. As ws < I, we compute <j max = 2. Since x' 6 = 2 = <r max , we shift 

x' 6 to the right of 5g and update /—>■/ — x' 6 (wg — wq) = 932 so that 

x= (1,2, 0,2,1A, <5 2 , 2). 

Again, since <S fails, we compare wr = 517 with I. As w? < /, we calculate <r max = 2. Since x ' 5 = 1 < <r max 
and <r max ui 7 = 1034 > J, we shift x ' 5 to the right of 62 and update I —> I — x' 5 (wr — Wg) = 484 so that 

x= (1,2,0,2, ^,<52,1,2). 

Since (0} fails again, we compare wq = 189 with I. As wg < /, we calculate <j max = 2. Since x ' 4 = 2 = <r max , 
we shift Xg to the right of 82 and update /—>•/ — x' 4 (wg — uq) = 156 so that 

x= (1,2,0, Jr, <y 2 ,2,l,2). 

Again, since (0} fails, we compare wg = 69 with I. As wg < /, we calculate <r max = 2. Since x' :i = 0 < er max and 
o’ma.xtt '5 = 138 < I, we set 62 = <T ma x = 2 and update the index /—>•/ — cr max wg = 18. This yields 

x = (1,2,0, <5!, 2, 2,1,2). 

It remains to apply algorithm D1 on the truncated codeword (x )4 = (1,2, 0,<5i) with I = 18 to decode <5i. 
Following Example [3 we find that <5i = 2 should be inserted at position 3. Hence, our final decoding is 

x= (1,2,2,0,2,2,1,2) = x. 


IV. Appendix 

A. Useful Lemmas 

In this appendix, we aim to show that the moment of a codeword is strictly less than twice the modulus defining 
its codebook. This allows us to precisely determine its moment based on the moment of the deleted codeword. 


Lemma 8. For d > 2, 


J2 Wi = 


2—1 


P - 

pd — 1 


(4) 


Proof: We argue by induction on n. It is straightforward to verify that (|4]) holds for n = 1. Next, assume that 
© holds for arbitrary n. Then for n + 1, since 


n+1 n 

^2 Wi = ^2 w i + Wn+l, 
2=1 2=1 
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it follows from the inductive hypothesis and the recurrence for w n+ \ that 


n+1 

^2 w i 

2 = 1 

fd-1 

V ( J2(d~ i)^-, ) - n 

\i—0 _ 

pd — 1 


pd(w n+ i) - w n+ i 
pd — 1 


P ^ (d - * - 1 )w n -.j + pd{w n+ 1 ) - (n + 1) 


pd — 1 


Then re-index the summation on the right-hand side and simplifying yields 


fd -1 


n+l P i)Wn+l-i ) - (?1 + 1) 

E _ \i=0 

* ~ pd - 1 


Hence, (0} holds for n+1. 

Lemma 9. For d > 2, 


5 > < 


2=1 


Proof: It follows from Lemma [8] that 


= 


2=1 


< 


P (d - ijwn-i'J - n 
pd — 1 

pd( E »»-i) ,/ n 

\i=o / a(w n +i -1) - n 


pd — 1 


pd — 1 


(5) 


< 


This proves (0). 


Lemma 10. Let x £ C n (q 1 d,m,r). Suppose x' is obtained by deleting c symbols from x, where c < d. If 
M(x') > r, t/ien M(x) = r + m. Otherwise, if M (x') < r, f/zen M(x) = r. 

Proof: Recall from our definition of x that M(x) = r (mod m). We claim that 


M(a;) < 2m. 


( 6 ) 


This follows from Lemma [9] 


n 

< p w t < 

2=1 


ps 

ps — 1 


ro n +i < 2w n+ i < 2m, 


where we have used the fact that ps/(ps — 1) < 2 since d > 2 and p > 1. 

If M(x') > r, then M(x) > r since M(x) > M(x'). It follows from (01 that M(x) = r + m. On the other 
hand, if M(x') < r, then we claim that M(x) = r. To prove this, assume on the contrary that M(x) = r + m. 
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TABLE III 

Binary 2-Deletion Codes: Values of N n (2, 2) and R n { 2, 2) 


n 

N n (2,2 ) 

Rn{ 2 ,2) 

i 

1 

0 , 1 

2 

1 

0, 1, 2, 3 

3 

2 

0 

4 

2 

0, 1, 2, 7 

5 

2 

0, 1, 2, 3, 4, 5, 6, 

7, 12, 13, 14, 19 

6 

3 

0, 1, 6, 7, 12, 13 

7 

4 

12, 13 

8 

5 

12, 33 

9 

6 

12, 33, 39, 45, 66 

10 

8 

66 

11 

9 

65, 66, 99, 100, 120, 

121, 154, 155 

12 

11 

65, 66, 99, 154, 155, 175, 

176, 181, 182, 187, 188, 

208, 209, 264, 297, 298 

13 

15 

297, 298 

14 

18 

297, 441, 475, 496, 530, 674 

15 

22 

297, 441, 674, 763, 784, 790, 
796, 817, 906, 1139, 1283 

16 

30 

1283 


Then 


It follows that 


which is a contradiction. 


M(x) - M(x') < p(/u; n _ c+ i + ... w n ) 

< W n+ 1 - p(w n _ d+ i + . . . + W n -c) 

< TO. 

M(x') > M(x) — to = r, 


B. Sizes o/ Generalized Heiberg Codes 

We present values for the size of the largest code in terms of the codeword length. Given positive integers q, d, 
n r, and to = w n +i, we denote the size of the largest code C n (q,d,w n +i,r) by 

N n (q,d)= max {\C n (q,d,w n+ i,r)\}. 

Also, let R n (q,d ) denote the set of values r for which \C n (q,d,w n +i,r )|= N n (q,d). 

Through exhaustive computer search, we computed the values of iV n (( 7 ,<i) and R n (q,d) for certain values of 
q, d, and n. Table ITHl gives values for N n {2,2) and R n ( 2,2) for binary 2-deletion codes (q = 2, d = 2) with n 
ranging from 1 to 15. Tables HV1 and [VI give values for ternary 2-deletion codes (q = 3, d = 2) and quaternary 
2-deletion codes (q = 4, d. = 2), respectively, but over a shorter range for n. 
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TABLE V 

Quaternary 2-Deletion Codes : Values of N n (4, 2) and R n (4, 



N n ( 4,2) 

-Rn(4, 2) 

1 

1 

0, 1, 2, 3 

2 

1 

0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 
12, 13, 14, 15 

B 

2 

0, 1, 2 

4 

2 

0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 
12, 13, 14, 61, 62, 63, 122, 123, 
124, 183, 184, 185 

B 

3 

0, 1, 61, 62 

B 

4 

61, 62, 122, 123, 183, 184 

7 

5 

61, 880 

8 

6 

61, 122, 183, 880, 941, 1760, 

1821, 2640, 2701, 3398, 

3459, 3520 
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